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(54) Apparatus and method for image data coding with additional data embedding 



(57) The invention relates to a coding apparatus for 
embedding second data into first data without deterio- 
ration of the first data, and a decoding apparatus for de- 
coding the coded data to the original first data and the 
second data without deterioration. The invention pro- 
vides the coding apparatus which includes a memory 
for storing at least partial data of the first data and em- 
beds the second data into the first data by performing 



rotation of the at least partial data stored in the memory 
in accordance with the second data; and provides the 
decoding apparatus in which at least partial data of the 
coded data embedded with the second data is rotated 
and a correlation with respect to peripheral data is cal- 
culated, so that the original first data and the second 
data are decoded in accordance with a rotation amount 
detemnined on the basis of the correlation. 
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Description 
BACKGROUND 

1. Field of the Invention 5 

[0001] The present invention relates to a coding ap- 
paratus and method, a decoding apparatus and method, 
a data processing system, a storage medium, and a sig- 
nal. In particular, the invention relates to a coding appa- io 
ratus and method, a decoding apparatus and method, 
a data processing system, a storage medium, and a sig- 
nal which allow information to be embedded Into data 
without deterioration in decoded data and without in- 
crease in data amount. is 
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which first data has been coded in accordance with sec- 
ond data, the decoding apparatus comprising a rotation 
section for rotating at last partial data of the coded data; 
a con-elation calculating section for calculating a corre- 
lation between the at least partial data rotated by the 
rotation section and peripheral data of the at least partial 
data; a second data decoding section for decoding the 
second data embedded in the coded data by detemnin- 
ing a rotation amount of the at least partial data of the 
coded data rotated by the rotation section on the basis 
of the correlation obtained by the con-elation calculating 
section; and first data decoding section for decoding the 
coded data to the original first data in accordance with 
the rotation amount determined by the second data de- 
coding section. 



2. Background of the Invention 

[0002] An example of a technique of embedding in- 
formation without increasing the data amount is such 20 
that the LSB or the lowest two bits of digital audio data 
are converted to information to be embedded. In this 
technique, the fact that the lowest bit or bits of digital 
audio data do not much influence its sound quality is 
utilized and the lowest bit or bits of digital audio data are 25 
simply replaced by information to be embedded. There- 
fore, at the time of reproduction, infonnation-embedded 
digital audio data is output as it is. that is, without return- 
ing the lowest bit or bits to the original state. That is, the 
digital audio data is output in a state that information is 30 
embedded therein because it is difficult to return the low- 
est bit or bits embedded Information to the original state 
and the lowest bit or bits do not much influence the 
sound quality. 

[0003] However, in the above technique, a signal that 35 
is different from the original signal is output. Therefore, 
Influence occurs in the sound quality when the signal is 
audio data or in the image quality when the signal is vid- 
eo data. 

40 

SUMMARY OF THE INVENTION 

[0004] Particular and preferred aspects of the inven- 
tion are set out in the accompanying independent and 
dependent claims. Features of the dependent claims ^s 
may be combined with those of the independent claims 
as appropriate and in combinations other than those ex- 
plicitly set out in the claims. 

[0005] An embodiment of the invention can provide a 
coding apparatus for coding first data in accordance with so 
second data, the coding apparatus comprising a mem- 
ory for storing at last partial data of the first data, and a 
coding section for embedding data in relation to the sec- 
ond data into the first data by rotating the at least partial 
data stored in the memory in accordance with the sec- 55 
ond data. 

[0006] An embodiment of the invention can also pro- 
vide a decoding apparatus for decoding coded data in 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] Exemplary embodiments of the invention are 
described hereinafter, by way of example only, with ref- 
erence to the accompanying drawings, in which: 
[0008] Fig. 1 is a block diagram showing an embodi- 
ment of an Image transmission system to which the 
present invention is applied. 

[0009] Fig. 2 is a view showing an image of an object 
to be coded in the present invention. 
[001 0] Fig. 3A is a conceptual view showing an image 
before it Is coded by using correlation or a decoded re- 
sult in an embodiment of the present invention. 
[0011] Fig. 3B is a conceptual view showing a result 
in which the image has been coded by using the corre- 
lation in the embodiment of the present invention. 
[0012] Fig . 4A is a conceptual view showing an image 
before it is coded by using continuity or a decoded result 
in an embodiment of the present invention. 
[0013] Fig. 4B is a conceptual view showing a result 
in which the image has been coded by using the conti- 
nuity in the embodiment of the present invention. 
[0014] Fig. 5A is a conceptual view showing an image 
before it is coded by using similarity or a decoded result 
in an embodiment of the present invention. 
[0015] Fig. 5B is a conceptual view showing a result 
in which the image has been coded by using the simi- 
larity in the embodiment of the present invention. 
[0016] Fig. 6 is a block diagram showing a structural 
example of hardware of an embedded encoder 3 of Fig. 
1. 

[0017] Fig. 7 is a block diagram showing a functional 
structural example of the embedded encoder 3 of Fig. 6. 
[0018] Fig. 8 is a flowchart for explaining the operation 
of the embedded encoder 3 of Fig. 7. 
[0019] Fig. 9A is a view before rotation at step S5 of 
Fig. 8. 

[0020] Fig. 9B is a view showing a first step of the ro- 
tation at step S5 of Fig. 8. 

[0021] Fig. 9C is a view showing a second step of the 
rotation at step S5 of Fig. 8. 

[0022] Fig . 1 0A is a view showing an image before the 
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processing of the embedded encoder 3 is carried out. 
[0023] Fig. 10B is a view showing the image after the 
processing of the embedded encoder 3 has been car- 
ried out. 

[0024] Fig. 11 is a block diagram showing a structural 5 
example of hardware of a decoder 6 of Fig. 1 , 
[0025] Fig. 1 2 is a block diagram showing a functional 
structural example of the decoder 6 of Fig. 11 . 
[0026] Fig. 1 3A is a view showing a coded image sup- 
plied to a line correlation calculating section 46 of Fig. 
12. 

[0027] Fig. 1 SB is a view showing a state in which a 
rotation operation is performed in the line correlation cal- 
culating section 46 of Fig. 12. 
[0028] Fig. 14 is a flowchart for explaining an opera- 
tion of the decoder 6 of Fig. 12. 
[0029] Fig . 1 5A is a view showing an example in which 
a rotation operation is performed in a vertical direction 
of an image. 

[0030] Fig. 1 5B is a view showing an example in which 20 
a rotation operation is performed in an oblique direction 
of an image. 

[0031] Fig. 16Alsaviewshowing a computer in which 
a program for causing execution of processing of the 
present invention is installed. ^5 
[0032] Fig. 16B is a view showing examples of stor- 
age media in which a program for causing execution of 
processing of the present invention is stored. 
[0033] Fig. 16C is a view showing a conception in 
which a program for causing execution of processing of 30 
the present invention is distributed in a computer 
through a satellite or a network. 
[0034] Fig. 17 is a block diagram of an example of a 
computer in which a program for causing execution of 
processing of the present invention is installed. 35 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0035] A coding apparatus and method, a decoding 
apparatus and method, a digital processing system, a 
storage medium, and a signal according to the present 
invention will be hereinafter described with reference to 
the accompanying drawings. 

[0036] Fig. 1 shows an example configuration of an 
embodiment of an image transmission system to which <5 
the invention is applied. The term "system** means a log- 
ical collection of a plurality of devices and whether the 
constituent devices are contained in the same body is 
irrelevant to the definition of this term. 
[0037] This image transmission system consists of a so 
coding apparatus 10 and a decoding apparatus 20. The 
coding apparatus 10 codes an object of coding such as 
an image and outputs coded data. The decoding appa- 
ratus 20 decodes coded data into the original image. 
[0038] An image database 1 stores images to be cod- 55 
ed, for example, digital images. A stored image is read 
out from the Image database 1 and supplied to an em- 
bedded encoder 3. 
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[0039] An additional information database 2 stores 
additional information, such as digital data, as informa- 
tion to be embedded into an image as a coding object. 
Stored additional information is read out from the addi- 
tional information database 2 and supplied to the em- 
bedded encoder 3, too. 

[0040] The embedded encoder 3 receives an image 
firom the image database 1 and additional Information 
from the additional information database 2. The embed- 
ded encoder 3 codes the image that is supplied from the 
image database 1 in accordance with the additional in- 
formation that is supplied from the additional information 
database 2 in such a manner that decoding will be per- 
formed by utilizing an energy deviation of the Image, and 
outputs a resulting image. That is, the embedded en- 
coder 3 codes the image by embedding the additional 
information Into the Image in such a manner that decod- 
ing will be performed by utilizing an energy deviation of 
the image, and outputs coded data. The coded data that 
is output from the embedded encoder 3 is recorded on 
a recording medium 4 such as a semiconductor memo- 
ry, a magneto-optical disc, a magnetic disk, an optical 
disc, a magnetic tape, or a phase change disc. Alterna- 
tively, the coded data is transmitted, as a signal, over a 
transmission medium 5 such as ground waves, a satel- 
lite channel, a CATV (cable television) network, the In- 
ternet, or public lines, and supplied to the decoding ap- 
paratus 20. 

[0041] The decoding apparatus 20 is a decoder 6, 
which receives coded data that is supplied via the re- 
cording medium 4 or the transmission medium 5. The 
decoder 6 decodes the coded data into the original im- 
age and the additional information by utilizing an energy 
deviation of the image. The decoded image Is supplied 
to a monitor (not shown), for example, and displayed 
thereon. The decoded additional information is text da- 
ta, audio data, a reduced image, or the like that relates 
to the image. 

[0042] Next, the principles of the embedded coding in 
the embedded encoder 3 shown In Fig. 1 and the de- 
coding in the decoder 6 also shown In Fig. 1 will be de- 
scribed. 

[0043] In general, what is called information has a de- 
viation of energy or entropy and the deviation is recog- 
nized as valuable information. For example, the reason 
why an image that is obtained by photographing a cer- 
tain scene is recognized by a human as an image of the 
scene is that the image, for example, pixel values of the 
respective pixels constituting the image, has an energy 
deviation corresponding to the scene. An image having 
no energy deviation is just noise or the like and is use- 
less information. 

[0044] Therefore, even if the original energy deviation 
of valuable Information is, say, broken, by performing a 
certain manipulation on the information, the valuable in- 
formation can be restored by restoring the original en- 
ergy deviation from the broken one. That is. coded data 
obtained by coding Information can be decoded Into the 
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original information by utilizing the original energy devi- 
ation of the Information. 

[0045] For example, the deviation of the energy of in- 
formation Is represented by con-elation, continuity, sim- 
ilarity, etc. 

[0046] The correlation of information means correla- 
tion between constituent elements (in the case of an im- 
age, pixels, lines, or the like that constitute the Image), 
for example, autocorrelation, or distance between a cer- 
tain constituent element and another one of the Infor- 
mation. An example of congelation is correlation between 
two lines of an image that is a correlation value repre- 
sented by the sum of the squares of the differences be- 
tween corresponding pixel values. 
[0047] For example, now assume an image 101 
formed by H lines 102 as shown In Fig. 2. In general, as 
shown in Fig. 3A, the correlation value between the first- 
row line (first line) 103 from the top of the image and 
each of the other lines is larger when the line is closer 
to the first line 103 (i.e., located higher in the image of 
Fig. 2) as indicated by a correlation value 201 with the 
Mth line, and is smaller when the line is more distant 
from the first line 103 (i.e., located lower In the image of 
Fig. 2) as indicated by a correlation value 202 with the 
Nth line. That is, there is a deviation of correlation values 
that the correlation value with the first line 103 is larger 
for a line closer to the first line 1 03 and smaller for a line 
more distant from the first line 103. 
[0048] In the image 101 of Fig. 2, a manipulation is 
performed that interchanges the pixel values of the Mth 
line 104 that Is relatively close to the first line 103 with 
those of the Nth line 105 that is relatively distant from 
the first line 103. Correlation values between the first 
line 103 and the other lines in the line-Interchanged im- 
age 101 are as shown in Fig. 3B, for example. 
[0049] In the line-interchanged image 101 , the corre- 
lation value with the Mth line 104 that is close to the first 
line 1 03 becomes small as indicated by a correlation val- 
ue 203 with the Mth line and the correlation value with 
the Nth line 105 that Is distant from the first line 103 be- 
comes large as indicated by a correlation value 204 with 
the Nth line. 

[0050] Therefore, In Fig. 3B, the deviation of congela- 
tion that the correlation value is larger for a line closer 
to the first line 103 and smaller for a line more distant 
from the first line 103 is broken. However, the broken 
deviation of correlation of the image can be repaired to 
the original state by utilizing the deviation of correlation 
that the correlation value Is larger for a line closer to the 
first line 103 and smaller for a line more distant from the 
first line 103. In Fig. 3B, the facts that the correlation 
value with the Mth line 104 that is close to the first line 
103 is small and the correlation value with the Nth line 
105 that is distant from the first line 103 is large are 
cleariy unnatural, and hence the original deviation of 
correlation Is restored by interchanging the Mth line 104 
and the Nth line 105 with each other. An Image having 
the deviation of congelation shown In Fig. 3A, that is, the 



6 

original image 101, Is restored by interchanging the Mth 
line 104 and the Nth line 105 In Fig. 38 with each other. 
[0051] In the case described above with reference to 
Figs. 2, and 3A and 38, the image is coded by line in- 
terchanging. In the coding, for example, the embedded 
encoder 3 determines based on additional information 
which lines should be moved or which lines should be 
Interchanged with each other. On the other hand, the 
decoder 6 restores the original image from a coded im- 
age, that is, a line-interchanged image, by moving the 
interchanged lines to their original positions by utilizing 
the congelation of the coded image. Further, in the de- 
coding, at the same time, the decoder 6 restores addi- 
tional Information embedded in the Image by detecting, 
for example, which lines were moved or which lines 
were interchanged with each other. 
[0052] As for the continuity of Information, assume 
that for a certain line of an image, a waveform 301 as 
shown in Fig. 4A Is observed in which the variation pat- 
tern of pixel values Is continuous. In another line that is 
distant from the above line, a variation pattern of pixel 
values is observed that is different in continuity from the 
variation pattern of the above line; a deviation of conti- 
nuity also exists. That is, when attention is paid to a cer- 
tain pixel value variation pattern, a deviation of continu- 
ity is found that a similar pixel value variation pattern 
exists in an adjacent portion and the pixel value variation 
pattern becomes more different as the position goes 
away. 

[0053] For example, part of the waveform 301 shown 
in Fig. 4A In which the variation pattern of pixel values 
is continuous is replaced by a waveform 301 that is dis- 
tant from the waveform 301 and has a different variation 
pattern of pixel values as shown in Fig. 48. 
[0054] In the case of Fig. 48, the above-described de- 
viation of continuity is broken. However, the broken de- 
viation of continuity can be repaired by utilizing the de- 
viation of continuity that portions adjacent to each other 
have continuous pixel value variation patterns and pixel 
value variation patterns become more different when 
they are more distant from each other. Specifically, in 
Fig. 48. the pixel value variation pattern 302 of the part 
of the waveform is cleariy different from the pixel value 
variation pattems of the other parts, and hence the de- 
viation of continuity of the original image can be restored 
by replacing the pixel value variation pattern 302 with a 
waveform having a pixel value variation pattern similar 
to the pixel value variation patterns of the other parts. 
The waveform shown in Fig. 4A. that Is, the original 
waveform, can be restored from the waveform shown In 
Fig. 48 by performing such replacement, 
[0055] In the case described above with reference to 
Figs. 4A and 48. the Image coding is to replace part of 
the waveform with a pixel value variation pattern that Is 
much different from adjacent pixel value variation pat- 
terns. In the coding, for example, the embedded encod- 
er 3 detemnlnes based on additional Infomnation what 
part of the wavefomn should be changed greatly in pixel 
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value variation pattern and how greatly the pixel value 
variation pattern should be changed. The decoder 6 re- 
stores the original wavefomri from a coded signal, that 
is, a waveform having a part with a much different pixel 
value variation pattern by utilizing the deviation of con- 5 
tinuity that adjacent pixel value variation patterns are 
continuous and pixel value variation patterns become 
more different when they are more distant from each 
other. Further, in the decoding, at the same time, the 
decoder 6 restores embedded additional information by 
detecting, for example, what part of the waveform was 
changed greatly in pixel value variation pattern and how 
greatly the pixel value variation pattern was changed. 
[0056] As for the similarity of information, it is known 
that part of an image obtained by photographing a 
scene, for example, is generated by utilizing fractal, that 
is, autosimilarity. of the image. For example, a photo- 
graphed image of a sea 401 and a forest 402 shown in 
Fig. 5A has a deviation of similarity that the similarity 
between the pixel value variation pattern of a portion of 
the sea 401 and that of another portion of the sea 401 
is high but the similarity between the pixel value varia- 
tion pattern of the same portion and that of a portion In 
the forest 402 that is distant from the sea 401 is low. The 
same thing is true of the similarity of a shape itself such 
as an edge shape pattern of an image portion rather 
than a pixel value variation pattern. 
[0057] For example, a part 403 of the sea 401 shown 
in Fig. 5A is replaced by a part 404 of the forest 402 as 
shown in Fig. 5B. 

[0058] In Fig. SB, the above-described deviation of 
similarity is broken. However, the broken deviation of 
similarity can be repaired by utilizing the deviation of 
similarity that adjacent pixel value variation patterns are 
high in similarity and the similarity becomes lower when 
pixel value variation patterns are more distant from each 
other. Specifically, in Fig. 58 in which part of Image of 
the sea 401 is made a part 405 of the image of the forest 
402, the similarity between a portion in the sea 401 and 
the replaced part 405 of the image of the forest 402 is 
cieariy lower than the similarity between portions within 
the image of the sea 401 . The deviation of similarity of 
the original image is restored by replacing the part 405 
that is made the image of the forest 402 with an image 
having characteristics that are similar to those of an im- 
age of the sea 401 around that part 405. that Is, a part 
406 of the image of the sea 401. The image shown in 
Fig. 5A, that is, the original image, is restored from the 
image shown in Fig. 58 by performing such replace- 
ment. 

[0059] In the case described above with reference to 
Figs. 5A and 58. the image coding Is to replace the part 

403 of the image of the sea 402 with the part 404 of the 
image of the forest 402. In the coding, for example, the 
embedded encoder 3 determines based on additional 
information what part (e.g., a position on the picture) of 
the image of the sea 401 should be replaced by the part 

404 of the image of the forest 402. The decoder 6 re- 



stores the original image shown in Fig. 5A from a coded 
signal, that is. the image of the sea 401 having the part 
405 of the image of the forest 402 by utilizing the devi- 
ation of similarity of the coded signal that adjacent pixel 
value variation pattems are high In similarity and the 
similarity becomes lower when pixel value variation pat- 
terns are more distant from each other. Further, in the 
decoding, at the same time, the decoder 6 restores em- 
bedded additional infomriation by, for example, detecting 
what part of the image of the sea 401 was replaced by 
part of the image of the forest 402. 
[0060] As described above, the embedded encoder 3 
codes a coding object image in accordance with addi- 
tional information so that decoding will be performed by 
utilizing an energy deviation of the image. The decoder 
6 decodes coded data into the original image and the 
additional information without any overhead for decod- 
ing by utilizing an energy deviation of the image. 
[0061] Since additional information is embedded into 
a coding object image, a resulting coded Image is ren- 
dered different from the original state and unrecogniza- 
ble as valuable information. That is, encryption of the 
coding object image without any overhead is realized. 
[0062] Further, completely reversible digital water- 
marking is realized. For example, in the conventional 
digital watermarking, the lowest bits of pixel values that 
do not much influence the image quality are simply 
changed to values corresponding to a digital watermart^. 
However, it is difficult to return the lowest bits to the orig- 
inal values. Therefore, changing the lowest bits as dig- 
ital watermarking causes deterioration in the image 
quality of a decoded image. In the embedded coding of 
the invention, in the case where coded data is decoded 
by utilizing an energy deviation of the original image, the 
original image having no deterioration and additional in- 
formation are obtained. Therefore, the image quality of 
a decoded Image Is not deteriorated even If the addi- 
tional information Is used as digital watemnarklng infor- 
mation. 

[0063] Since embedded additional Information is tak- 
en out by decoding coded data Into an image, side in- 
formation is provided without any overhead. In other 
words, since additional Information is embedded Into an 
image without any overhead that is usually necessary 
to take out the additional information, coded data that is 
obtained as a result of the embedding is compressed by 
an amount con-esponding to the additional information. 
For example, if a half of an image is made a coding ob- 
ject and the other half is made additional information and 
if the latter half of the image is embedded into the half 
image as the coding object, the image is simply com- 
pressed into 1/2 of the original Image. 
[0064] Since coded data is decoded by utilizing an en- 
ergy deviation of the original image which Is, so to 
speak, a statistical quantity, the error resistance is high. 
That Is, robust coding which Is coding high in robustness 
is realized. 

[0065] Since coded data is decoded by utilizing an en- 
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ergy deviation of the original image, there is a possibility 
that more additional information is embedded when the 
energy deviation is more characteristic, that is, when, in 
the case of an image, the activity of the image is higher 
or Its redundancy is lower. As described above, coded 
data obtained as a result of embedding of additional in- 
formation is compressed by an amount corresponding 
to the additional information. That is, the compression 
ratio is larger when the activity of the Image is higher or 
the redundancy of the image is lower. For example, in 
the MPEG (Moving Picture Experts Group) scheme 
which is a conventional coding scheme, basically the 
compression ratio is smaller when the activity of an im- 
age Is higher or the redundancy of an Image is lower. 
The embedded coding scheme of the invention is much 
different from the conventional coding schemes in this 
respect. 

[0066] An image can be provided with a voice used 
as a key by making an image a coding object and em- 
ploying, as additional information, information of a dif- 
ferent medium than an image, for example, a voice. 
Specifically, on the coding apparatus 10 side, a voice 
spoken by the subscriber, such as "Open sesame," is 
embedded as additional information into an image. On 
the decoding apparatus 20 side, a user is caused to 
speak a voice "Open sesame" and speaker recognition 
is performed by comparing the voice of the user with the 
voice embedded in the image. This speaker recognition 
allows automatic presentation of the image only when 
the user is recognized as the subscriber. A voice wave- 
form itself, as well as what is called a feature parameter 
of a voice, can be used as a voice as additional infor- 
mation. 

[0067] A voice can be provided with an image used 
as a key (e.g., voice response after face recognition) by 
making a voice a coding object and employing, as ad- 
ditional information, Information of a media different 
than a voice, for example, an image. Specifically, on the 
coding apparatus 1 0 side, an image of the face of a user 
Is embedded Into, for example, a voice as a response 
to the user. On the decoding apparatus 20 side, the face 
of a user is photographed and a voice in which a face 
image that matches the photographed image is embed- 
ded is output. In this manner, a voice response system 
that makes voice responses that are different for respec- 
tive users is realized. 

[0068] It is also possible to embed information of a 
certain medium into another information of the same 
medium such as embedding one voice into another 
voice or embedding one image into another image. Fur- 
ther, by embedding a voice and a face Image of the sub- 
scriber, vyhat is called a double key system can be real- 
ized in which an image can be presented only when a 
voice and a face image of a user coincide with those 
embedded in the image. 

[0069] For example, it is also possible that one of an 
image and a voice that constitute a television broadcast 
signal and are, so to speak, synchronized with each oth- 



er is embedded into the other. In this case, what is called 
a true integrated signal can be realized in which pieces 
of information of different media are integrated with each 
other. 

5 [0070] In the embedded coding scheme, as described 
above, more additional information may be embedded 
into information when the energy deviation of the infor- 
mation is more characteristic. Therefore, the overall da- 
ta amount is controlled by for example, adaptively se- 

10 lecting one of two pieces of information having a more 
characteristic energy deviation and embedding the oth- 
er into the selected piece of information. That is, it be- 
comes possible to cause one of two pieces of informa- 
tion to absorb the infonmation quantity of the other. Con- 

15 trolling the overall data amount enables information 
transmission using a data amount that conforms to the 
transmission bandwidth and the use status of a trans- 
mission line and other factors of the transmission envi- 
ronment (i.e.. environment-adaptive network transmis- 

20 sion). 

[0071] For example, coding in which higher-layer In- 
formation having a smaller information quantity than 
lower-layer information is generated (what is called lay- 
ered coding) is realized without increasing the data 
25 amount by embedding a reduced image into the original 
image or by embedding a decimated voice Into the orig- 
inal voice. 

[0072] For example, by embedding an image to serve 
as a key for retrieving each original image into each orig- 

30 inal image, a database is realized in which an image is 
retrieved based on a key image. 
[0073] Fig. 6 shows an example hardware configura- 
tion of the embedded encoder 3 shown in Fig. 1 which 
performs embedded coding In which additional informa- 

35 tion is embedded into an image so that the original Im- 
age can be restored by utilizing the correlation of the 
image. 

[0074] An image that is supplied from the image da- 
tabase 1 is supplied to a frame memory 31. The frame 
40 memory 31 temporarily stores, for example, on a frame- 
by-frame basis, the Image supplied from the image da- 
tabase 1 . 

[0075] A CPU (Central Processing Unit) 32 executes 
a program stored in a program memory 33, and makes 

45 such control that an embedding coding processing de- 
scribed later is carried out. That is, the CPU 32 receives 
additional information supplied from an additional infor- 
mation data base 2, and controls the whole embedding 
encoder so that the additional information is embedded 

50 In accordance with the program into the image stored in 
the frame memory 31. Specifically, the CPU 32 shifts, 
for example, one line in a horizontal direction, that is, a 
series of pixels arranged in the horizontal direction, 
which constitutes the image stored in the frame memory 

55 31, toward the horizontal direction on the basis of the 
additional information, so that it makes such control that 
the additional information is embedded in each line. The 
image embedded with the additional information Is con- 
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trolled by the CPU 32 so that it is output as coded data. 
[0076] The program memory 33 is constituted by, for 
example, a ROM (Read-only memory) or a RAM (Ran- 
dom access memory). A computer program and neces- 
sary data for causing the CPU 32 to carry out the em- s 
bedding coding processing are stored in the program 
memory 33. 

[0077] The frame memory 31 is constituted by a plu- 
rality of banks so that a plurality of frames are stored. In 
the frame memory 31 , storing of an image supplied from 
the image database 1 . stonng of an image as an object 
of an embedding coding processing by the CPU 32, and 
outputting of an image after the embedding coding 
processing, that is, outputting of the coded data are car- 
ried out at the same time by changing the banks. Even 
if images supplied from the image database 1 are mov- 
ing pictures, the coded data Is output in real time. 
[0078] Fig. 7 shows a functional structural example of 
the embedded encoder 3 of Fig. 6. The computer pro- 
gram stored in the program memory 33 is executed by 
the CPU 32, so that the functional structure shown in 
Fig. 7 is realized. 

[0079] As explained in Fig. 6, the frame memory 31 
temporarily stores images supplied from the image da- 
tabase 1 . A line slide section 36 reads out additional in- 
formation from the additional information database 2, 
and shifts a predetermined line constituting an image 
stored in the frame memory 31 toward a horizontal di- 
rection by a shift amount corresponding to the additional 
information, so that the additional information is embed- 
ded in the line and It is output as coded data. 
[0080] With reference to a flowchart of Fig. 8, an em- 
bedding coding processing carried out in the embedded 
encoder 3 of Fig. 7 will be described. 
[0081] Images stored in the Image database 1 are 
read out, and are sequentially supplied and stored in the 
frame memory 31 . 

[0082] The line slide section 36 reads out, at step SI , 
a predetermined line constituting an Image stored in the 
frame memory 31. The processing operation proceeds 
to step S2, and it is judged whether or not the read out 
line, that is, a marked line is a first line, that Is, an up- 
permost line of the image of one frame. At step S2, in 
the case where the marked line is the first line, the 
processing operation proceeds to step S3, and the line 
slide section 36 outputs the first line directly as coded 
data, and the processing operation skips steps S4 to S6 
and proceeds to step S7. 

[0083] At step S2. in the case where it is judged that 
the marked line is not the first line, that is, in the case 
where the marked line is some line subsequent to a sec- 
ond line, the processing operation proceeds to step S4, 
and the line slide section 36 reads out additional infor- 
mation to be embedded in the marked line from the ad- 
ditional infomnation database 2, and the processing op- 
eration proceeds to step S5. At step 85, in the line slide 
section 36, rotation of the marked line is perfomned to- 
ward the horizontal direction by the number of pixels cor- 
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responding to the additional information read out at step 
S4. 

[0084] That is, for example, as shown in Fig. 9A, It is 
assumed that the Nth line (N 1 ) is the marked line. As 
shown in Fig. 9B, the line slide section 36 slides the Nth 
line by the same number of pixels as the value of the 
additional infonnation toward a left or right direction of 
the horizontal direction, for example, the right direction. 
The line slide section 36 inserts a portion of the Nth line 
projected by sliding toward the right of the frame into the 
left side of the Nth line as shown in Fig. 9C. 
[0085] In the case where the additional information is 
image data, the rotation of the Nth line is not performed 
by the same number of pixels as the value of the addi- 
tional information as described above, but the rotation 
of the Nth line may be performed according to its char- 
acteristic amount, that is, a histogram, OR, dispersion, 
etc. 

[0086] After the line slide section 36 rotates the 
marked line, the processing operation proceeds to step 
S6, and the line slide section 36 outputs the marked line 
after the rotation as the coded data, and then, the 
processing operation proceeds to step S7. 
[0087] At step S7, it is judged whether or not an image 
which has not been read out is stored in the frame mem- 
ory 31, and in the case where it is judged that such an 
image is stored, the processing operation returns to step 
81, and for example, a line below the mariced line by 
one line or a first line of a new frame is read out as a 
new marked line, and the same processing is subse- 
quently repeated. 

[0088] At step S7, in the case where it is judged that 
an image which has not been read out is not stored in 
the frame memory 31 , the embedding coding process- 
ing is ended. 

[0089] According to the embedding coding process- 
ing as described above, an image of some one frame is 
coded into coded data as follows: 
[0090] That is, for example, in the case where 10, 150. 
200, - are embedded as additional information into an 
image as shown in Fig. IDA, a first line is output as it is, 
as shown in Fig. 10B, and a second line is rotated toward 
the right direction by 10 pixels of the same value as the 
first additional information. Further, a third line is rotated 
toward the right direction by 1 50 pixels of the same value 
as the second additional information. A fourth line is ro- 
tated toward the right direction by 200 pixels of the same 
value as the third additional information. A fifth line and 
the following are similarly rotated toward the right direc- 
tion by the number of pixels corresponding to the addi- 
tional information. 

[0091] As described above. In the case where the line 
slide section 36 rotates a line constituting an image 
stored in the frame memory 31 toward the right direction 
by the number of pixels con-esponding to the additional 
information so that additional information is embedded 
in each line, the original image is decoded by performing 
the reverse rotation, and the reverse rotation becomes 
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the additional information. Thus, the additional informa- 
tion is embedded in the image while picture quality of 
the image is not deteriorated and an amount of data Is 
not increased. 

[0092] That is, the rotated line as the line in which the 5 
additional information has been embedded is reversely 
rotated without an overhead to the correct position by 
using correlation of images, that is, here, correlation with 
respect to the line positioned at the correct position, and 
the additional Information is decoded. Thus, deteriora- io 
tion in picture quality by embedding of the additional in- 
formation does not occur in the obtained decoded im- 
age. 

[0093] In the case where a line located at a correct 

position does not exist In the coded data, It is difficult 15 
that the image and additional information are decoded 
by using the conrelation of images as described above. 
In the embedding coding processing of Fig. 8, the first 
line of each frame is directly output as coded data while 
additional information is not embedded, that is, rotation 20 
Is not performed. 

[0094] Fig. 11 shows a structural example of hard- 
ware of the decoder 6 of Fig. 1 for decoding the coded 
data output from the embedded encoder 3 of Fig. 7 Into 
the original image and additional information by using 25 
the correlation of Images. 

[0095] Coded data, that is. an image in which addi- 
tional Information has been embedded or an embedded 
Image is supplied to a frame memory 41. The frame 
memory 41 temporarily stores the embedded image in 30 
a unit of, for example, a frame. The frame memory 41 
is also constituted similarly to the frame memory 31 of 
Fig. 6, and changing of banks is performed, so that even 
if the embedded images are moving pictures, a real-time 
processing is performed. 35 
[0096] A CPU 42 executes a program stored in a pro- 
gram memory 43. so that a decoding processing de- 
scribed later is carried out. That is, the CPU 42 decodes 
the embedded image stored in the frame memory 41 
into the original Image and the additional information by 40 
using the correlation of images. Specifically, the CPU 42 
calculates a correlation value of a line constituting the 
embedded Image with respect to a line upper by one 
line while performing rotation of the line toward the hor- 
izontal direction for, for example, every pixel. The CPU 45 
42 outputs, as a decoding result of the additional infor- 
mation, a rotation amount when the correlation value be- 
comes maximum, and performs rotation by the rotation 
amount, so that the decoded image, that is. the original 
Image is output. so 
[0097] The program memory 43 is constituted, for ex- 
ample, similarly to the program memory 33 of Fig. 6, and 
stores a computer program etc. for causing the CPU 42 
to execute the decoding processing. 
[0098] Fig. 12 shows a functional structural example 55 
of the decoder 6 of Fig. 11. The functional structure 
shown in Fig. 12 is realized through execution of the 
computer program stored in the program memory 43 by 



the CPU 42. 

[0099] The frame memory 41 temporarily stores the 
embedded image as explained in Fig. 11. 
[0100] A line correlation calculating section 46 reads 
out a predetenmined line of the embedded image stored 
In the frame memory 41 , and while the line is rotated by 
one pixel toward either one of the right and left direc- 
tions, the line correlation calculating section 46 calcu- 
lates a correlation value between the line after rotation 
and a line at a row upper the line by one. That is, as 
shown in Fig. 13A, the line correlation calculating sec- 
tion 46 reads out a line to be decoded in the embedded 
image stored in the frame memory 41 , that is, a marked 
line and a line above the mariced line by one, that is, a 
key line which becomes, so to speak, a key for decoding 
the marked line. The line correlation calculating section 
46 calculates a correlation value between the marked 
line and the key line. As shown in Fig. 13B, the line cor- 
relation calculating section 46 rotates the marked line 
by one pixel toward either one of the left and right direc- 
tions. In Fig. 13B, the marked line Is rotated toward the 
left direction opposite to the case explained in Fig. 9A, 
Fig. 9B and Fig. 9C. The line correlation calculating sec- 
tion 46 calculates the correlation value between the 
marked line after rotation toward the left direction and 
the key line. Subsequently, in the same manner, the line 
correlation calculating section 46 calculates the con-e- 
lation value with respect to the key line while rotating 
the marked line until the marked line is returned to the 
original position, that is, the original position on the cod- 
ed embedded Image. 

[0101] Here, although various methods are conceiv- 
able for calculation of the correlation value between 
lines, for example, the sum of the differences of pixel 
values for one line, such as corresponding pixels 501 
and 502, 503 and 504, ■ ■ ■ between the key line and the 
marked line, or the sum of the squares of the differences 
is conceivable. At this time, as the correlation value be- 
comes small, the correlation between the lines becomes 
large. 

[0102] All the correlation values between the marked 
line and the key tine at each rotation amount obtained 
by the line con-elation calculating section 46 are sup- 
plied to a rotation amount determining section 47. The 
rotation amount determining section 47 detects a max- 
imum value of correlation between the marked line and 
the key line on the basis of the correlation values sup- 
plied from the line correlation calculating section 46. The 
rotation amount determining section 47 determines a ro- 
tation amount of the marked line when the maximum val- 
ue is obtained as a final rotation amount of the marked 
line, that is, as a determined rotation amount. The de- 
termined rotation amount is output as a decoded result 
of the additional information, and is supplied to a line 
slide section 48. 

[0103] The line slide section 48 rotates the marked 
line stored in the frame memory 41 by the rotation 
amount supplied from the rotation amount determining 
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section 47 toward the left direction similar to the case at 
the line correlation calculating section 46, and further, 
reads out the marlced line after rotation, and outputs it 
as a decoded result of the marked line. 
[0104] With reference to a flowchart of Fig. 14. a de- 5 
coding processing carried out in the decoder 6 of Fig. 
12 will be described. 

[01 05] Supplied embedded images, that is, coded da- 
ta is sequentially stored in the frame memory 41 in a unit 
of. for example, one frame. 

[01 06] In the line correlation calculating section 46, at 
step S11, a predetermined line of the embedded Image 
stored in the frame memory 41 Is read out as a marl<ed 
line. Then the processing operation proceeds to step 
S12, and it is judged whether or not the marked line is 
a first line. At step S12. in the case where the marked 
line is the first line, the processing operation proceeds 
to step S13, and the line slide section 48 reads out the 
marked line as the first line from the frame memory 41 , 
and outputs it as it is. The processing operation skips 
steps S14 to S19 and proceeds to step S20. That Is, in 
this embodiment, from the above, the additional infor- 
mation is not embedded in the first line, that is, the first 
line is not rotated, so that the first line is output as it is. 
[01 07] At step SI 2, in the case where the marked line 
is not the first line, that is, in the case where the marked 
line is some line subsequent to a second line, the 
processing operation proceeds to step S14. At step S14. 
the line correlation calculating section 46 reads out, as 
a key line, a tine above the marked line by one line from 
the frame memory 41 , and the processing operation pro- 
ceeds to step S15. At step SI 5, in the line correlation 
calculating section 46, a correlation value between the 
marked line and the key line, that Is. a line correlation 
value is calculated, and is output to the rotation deter- 
mining section 47. 

[0108] In the line con-elation calculating section 46, for 
example, the sum of or the sum of the squares of the 
differences between each pixel constituting the marked 
line and a pixel of the key line at the same row as the 
pixel of the marked line is calculated as a correlation 
value between the marked line and the key line. Thus, 
when the correlation value takes a minimum value, the 
correlation between the marked line and the key line be- 
comes maximum. 

[0109] After the processing at step S1 5, the process- 
ing operation proceeds to step SI 6, and in the line cor- 
relation calculating section 46, the marked line is rotated 
by one pixel toward the left direction. The processing 
operation proceeds to step SI 7. and it is judged wheth- 
er, since the marked line is rotated at step S16, each 
pixel of the marked line after the rotation is returned to 
the position of each pixel of the marked line stored in 
the frame memory 41. 

[0110] At step S1 7, in the case where it is judged that 
each pixel of the marked line after the rotation is not re- 
turned to the position of each pixel of the marked line 
stored in the frame memory 41 . the processing opera- 



tion retums to step SI 5. Then a correlation value be- 
tween the marked line after the rotation and the key line 
is calculated and the same processing is subsequently 
repeated. 

[0111] At step S17. in the case where It Is judged that 
each pixel of the marked line after the rotation is re- 
turned to the position of each pixel of the marked line 
stored In the frame memory 41. the processing opera- 
tion proceeds to step S18. In the rotation amount deter- 
mining section 48, based on the correlation value sup- 
plied from the line correlation calculating section 46. a 
maximum value of correlation between the marked line 
and the key line is detected, and a rotation amount of 
the marked line when the maximum value Is obtained Is 
determined as a determined rotation amount. The rota- 
tion amount determining section 47 supplies the deter- 
mined rotation amount to the line slide section 48, and 
outputs it as a decoded result of the additional informa- 
tion embedded in the marked line, and the processing 
operation proceeds to step SI 9. 
[0112] At step S19, in the line slide section 48. the 
marked line stored in the frame memory 41 is rotated 
toward the left direction similar to the case of the line 
correlation calculating section 46 by the rotation amount 
supplied from the rotation amount determining section 
47. The line slide section 48 reads out the marked line 
after the rotation toward the left direction, and outputs it 
as a decoded result of the marked line, and the process- 
ing operation proceeds to step S20. 
[Oil 3] At step S20, it is judged whether or not an em- 
bedded image which has not been processed is stored 
in the frame memory 41 . In the case where such an im- 
age is stored in the frame memory 41, the processing 
operation returns to step S11. and for example, a line 
below the marked line by one line or a first line of a frame 
of a new embedded image is read out as a new marked 
line, and the same processing Is repeated subsequently. 
[0114] At step 520, in the case where it is judged that 
an embedded image which has not been processed is 
not stored In the frame memory 41. the decoding 
processing is ended. 

[0115] As described above, according to the embed- 
ded encoder 3 and the decoder 6 of the present inven- 
tion, since coded data as an image in which additional 
information has been embedded is decoded into the 
original image and the additional information by using 
the correlation of images, even if an overhead for de- 
coding is not provided, the coded data can be decoded 
into the original image and the additional information. 
Thus, the decoded image does not suffer deterioration 
In picture quality due to embedding of the additional In- 
formation. 

[0116] In this embodiment, although the sum of or the 
sum of the squares of the differences between corre- 
sponding pixels is used as a correlation value between 
the marked line and the key line, a correlation value is 
not limited to this. 

[0117] In this embodiment, since one line is structured 
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SO as to be rotated in accordance with a piece of addi- 
tional information, it is possible to embed additional in- 
formation with a value within the range of the number of 
pixels constituting one line. Embedding of additional in- 
formation with a value in the range larger than the s 
number of pixels constituting one line is possible by 
adopting such a structure that a plurality of lines, for ex- 
ample, two lines are rotated in accordance with a piece 
of additional information. 

[0118] In this embodiment, a line of pixels of an image 
arranged in the horizontal direction is rotated in accord- 
ance with additional information. However, for example, 
as shown in Fig. 1 5A, it is also possible that the arrange- 
ment of pixels of an image in the vertical direction is ro- 
tated, or as shown in Fig. 1 5B, the arrangement of pixels 
of an image in an oblique direction is rotated. It is also 
possible to modify such that the arrangement of pixels 
at the same position in a predetermined number of 
frames arranged in a time direction is rotated, or rotation 
is performed toward at least two directions of the hori- 
zontal direction, vertical direction, oblique direction, and 
time direction at the same time. 
[0119] In this embodiment, although only the first line 
of each frame is not rotated, it is also possible that, for 
example, only the lowermost line is made not to be ro- 
tated. In this case, in the decoding processing, a marked 
line is decoded in sequence from a line of a lower row 
by using a line lower than the marked line by one line 
as a key line. 

[0120] It is also possible that lines of each frame are 
made not to be rotated every two lines. In this case, in 
the decoding processing, a rotated marked line is de- 
coded with lines above and below the marked line as 
key lines, so that it is decoded more accurately. 
[0121] In this embodiment, although a marked line is 
decoded by using only a line above the marked line by 
one line as a key line, it is also possible that for example, 
two or more lines above the marked line are made key 
lines. 

[01 22] Although it takes a time to perform calculation, 
it is also possible to stnjcture such that a key line is not 
provided but rotation is performed to all lines. 
[0123] The additional information is not particularly 
limited, and for example, an image, a sound, a text, a 
computer program, a control signal, or other data may 
be used. If a part of an image of the image database 1 
is additional information and a remaining image is sup- 
plied to the frame memory 31, the part of the image as 
the additional infomnation is embedded in the remaining 
image portion, so that compression of the image is re- 
alized. 

[01 24] Although the embodiment of the present inven- 
tion is expressed with images, it is also possible to struc- 
ture such that a data line of sound for a predetermined 
time is rotated. 

[0125] Although this embodiment is structured such 
that under the control of the CPU 32 or 42, a computer 
program is executed so that the embedding coding 



processing or decoding processing is carried out, the 
processing may be carried out by dedicated hardware. 
[0126] In this embodiment, although a computer pro- 
gram executed under the control of the CPU 32 or 42 is 
stored in the program memory 33 or 43, the computer 
program may be provided as a signal through a record- 
ing medium such as a semiconductor memory, a mag- 
netic tape, a magnetic disc, an optical disc, a magneto- 
optical disc, or a phase change disc, or through a trans- 
mission medium such as the Internet, a ground wave, a 
satellite channel, a public network, or a CATV (cable tel- 
evision) network. 

[0127] With reference to Fig. 16A, Fig. 16B and Fig. 
16G, a description will be made on a recording medium 
recorded with a computer program, which is used so that 
the foregoing computer program is installed into the 
computer and Is made a state in which it can be execut- 
ed by the computer, and on a signal supplied to the com- 
puter through a transmission medium. 
[0128] As shown in Fig. 16A, a program is previously 
recorded in a hard disc 602 or a semiconductor memory 
603 as a built-in recording medium in a computer 601. 
[0129] Alternatively, as shown in Fig. 16B, a program 
is temporarily or permanently recorded in a recording 
medium, such as a floppy disc 611, a CD-ROIVI (Com- 
pact Disc Read-only memory) 612, an MO (Magneto- 
optical) disc 613, a DVD (Digital Versatile Disc) 614, a 
magnetic disc 615, or a semiconductor memory 616. 
[0130] In addition to the case where a program is in- 
stalled from the foregoing recording medium into the 
computer, as shown in Fig. 16C, it is possible to struc- 
ture such that the program is transmitted to the compu- 
ter 601 from a download site 621 by wireless through 
an artificial satellite 622 for digital satellite broadcasting, 
or is transmitted to the computer 601 with wire line 
through a network 631 such as a LAN (Local Area Net- 
woric) or the Intemet, so that it is installed into the built- 
in hard disc 602 in the computer 601 . 
[0131] Steps described through the program for per- 
forming various kinds of processing according to the 
present invention are not necessarily processed in time 
series along the sequence set forth as a flowchart, but 
they include also a processing executed in parallel or 
individually, for example, a parallel processing or 
processing by an object. 

[0132] Fig. 1 7 shows a structural example of the com- 
puter 601 of Fig. 16A and Fig. 16C. 
[0133] As shown in Fig. 17. the computer 601 has a 
built-in CPU (Central Processing Unit) 642. An input/ 
output interface 645 is connected to the CPU 642 
through a bus 641. When an instruction is inputted 
through the input/output interface 645 by a user's oper- 
ation to an input section 647 constituted by a keyboard, 
a mouse, etc., the CPU 642 executes a program stored 
in a ROM (Read-only memory) 643 corresponding to the 
semiconductor memory 603 of Fig. 16A in accordance 
with the instruction. The flowchart shown in Fig, 8 or Fig. 
14 is executed as this program. Alternatively, the CPU 
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642 loads a program stored in the hard disc 602, a pro- 
gram which was transmitted from the satellite 622 or the 
network 631 , was received by a communication section 
648, and was Installed in the hard disc 602, or a program 
which was read out from the floppy disc 611, the CD- 
ROM 612, the MO disc 613, the DVD 614, the magnetic 
disc 615. or the semiconductor memory 616 mounted 
on a drive 649 and was installed in the hard disc 602, 
into a RAM (Random access memory) 644 and exe- 
cutes the program. The CPU 642 outputs a processing 
result through, for example, the input/output interface 
645 to a display section 646 constituted by an LCD (Liq- 
uid Crystal Display) as the need arises. 
[01 34] A computer program product for implementing 
the invention can be In the form of a computer program 
on a carrier medium. The carrier medium could be a 
storage medium, such as solid state magnetic optical, 
magneto-optical or other storage medium. The carrier 
medium could be a transmission medium such as 
broadcast, telephonic, computer network, wired, wire- 
less, electrical, electromagnetic, optical or indeed any 
other transmission medium. 



Claims 

1. A coding apparatus for coding first data in accord- 
ance with second data, comprising: 

storage means for storing at least partial data of 
said first data; and 

coding means for embedding data in relation 
to said second data into said first data by rotating 
said at least partial data stored In said storage 
means in accordance with said second data. 

2. The coding apparatus according to claim 1 , further 
comprising input means for inputting said first data 
and said second data. 

3. The coding apparatus according to claim 1 , where- 
in: said first data is Image data composed of a plu- 
rality of pixel data; 

said storage means stores a series of pixel data 
arranged in a predetermined direction on said 
first image data; and 

said coding means performs a rotation opera- 
tion of said series of pixel data stored in said 
storage means toward said predetermined di- 
rection in accordance with said second data, so 
that said data In relation to said second data is 
embedded in said first Image data. 

4. The coding apparatus according to claim 3, wherein 
said coding means rotates said series of pixel data 
arranged in said predetermined direction on said 
first image data and in a frame of said image data 
toward said predetermined direction in accordance 



with said second data. 

5. The coding apparatus according to claim 3, wherein 
said coding means performs a rotation operation of 

5 pixels of one line arranged in a horizontal direction 
on said first image data toward said horizontal di- 
rection in accordance with said second data. 

6. The coding apparatus according to claim 1 , wherein 
10 rotation of said first data by said coding means is 

prohibited In a part of said first data. 

7. The coding apparatus according to claim 3, wherein 
said coding means rotates said first image data in 

15 proportion to the number of pixels corresponding to 
a value of said second data toward said predeter- 
mined direction. 

8. A coding method for coding first data in accordance 
20 with second data, comprising: 

a step of storing at least partial data of said first 
data; and 

a coding step of embedding data in relation to 
25 said second data into said first data by rotating 

said stored at least partial data in accordance 
with said second data. 

9. The coding method according to claim 8, further 
30 comprising a step of inputting said first data and 

said second data. 

10. The coding method according to claim 8, wherein: 

35 said first data is image data composed of a plu- 

rality of pixel data; 

in said storing step, a series of pixel data ar- 
ranged in a predetermined direction on said first 
image data is stored; and 

40 in said coding step, a rotation operation of said 

stored series of pixel data is performed toward 
said predetermined direction in accordance 
with said second data, so that said data in re- 
lation to said second data is embedded In said 

45 first image data. 

11. The coding method according to claim 10, wherein 
in said coding step, said series of pixel data ar- 
ranged in said predetermined direction on said first 

50 image data and in a frame of said image data is ro- 
tated toward said predetermined direction in ac- 
cordance with said second data. 

12. The coding method according to claim 10, wherein 
55 In said coding step, a rotation operation of pixels of 

one line arranged In a horizontal direction on said 
first image data is performed toward said horizontal 
direction in accordance with said second data. 
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13. The coding method according to claim 8. wherein 
rotation of said first data In said coding step is pro- 
hibited in a part of said first data. 

14. The coding method according to claim 10. wherein 
in said coding step, said first image data is rotated 
in proportion to the number of pixels corresponding 
to a value of said second data toward said prede- 
termined direction. 

15. A decoding apparatus for decoding coded data in 
which first data has been coded in accordance with 
second data, comprising: 

rotation means for rotating at least partial data 
of said coded data; 

correlation calculating means for calculating a 
correlation between said at least partial data ro- 
tated by said rotation means and peripheral da- 
ta of said at least partial data; 
second data decoding means for decoding said 
second data embedded in said coded data by 
determining a rotation amount of said at least 
partial data of said coded data rotated by said 
rotation means based on said correlation ob- 
tained by said correlation calculating means; 
and 

first data decoding means for decoding said 
coded data to said original first data in accord- 
ance with said rotation amount determined by 
said second data decoding means. 

16. The decoding apparatus according to claim 15, 
wherein said second data decoding means obtains 
a plurality of correlations between said at least ro- 
tated partial data and said peripheral data of said at 
least partial data for every different value of said ro- 
tation amount, and determines said rotation amount 
when said correlation is maximum. 

17. The decoding apparatus according to claim 15, 
wherein said first data is image data composed of 
a plurality of pixel data, and 

said rotation means rotates pixel data of one 
line arranged in a horizontal direction on said coded 
data toward said horizontal direction. 

18. The decoding apparatus according to claim 15, 
wherein rotation by said rotation means is prohibit- 
ed in a part of said coded data. 

19. The decoding apparatus according to claim 15, 
wherein said second data decoding means deter- 
mines a rotation amount of said at least partial data 
of said coded data rotated by said rotation means, 
and makes a value corresponding to said rotation 
amount said second data. 
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20. A decoding method for decoding coded data in 
which first data has been coded in accordance with 
second data, comprising: 

a step of rotating at least partial data of said 
coded data; 

a step of calculating a correlation between said 
rotated at least partial data and peripheral data 
of said at least partial data; 
a step of decoding said second data embedded 
In said coded data by determining a rotation 
amount of said at least partial data of said cod- 
ed data rotated in said rotating step based on 
said con-elation; and 

a step of decoding said coded data to said orig- 
inal first data in accordance with said deter- 
mined rotation amount. 

21 . The decoding method according to claim 20, where- 
in In said step of decoding said second data, a plu- 
rality of correlations between said rotated at least 
partial data and said peripheral data of said at least 
partial data are obtained for every different value of 
said rotation amount, and said rotation amount 
when said correlation is maximum is determined. 

22. The decoding method according to claim 20. where- 
in said first data is image data composed of a plu- 
rality of pixel data, and 

in said rotating step, pixel data of one line ar- 
ranged In a horizontal direction on said coded data 
Is rotated toward said horizontal direction. 
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The decoding method according to claim 20, where- 
in rotation in said rotating step is prohibited in a part 
of said coded data. 
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24. The decoding method according to claim 20, where- 
in in said step of decoding said second data, a ro- 
tation amount of said at least partial data of said 
coded data rotated in said rotating step is deter- 
mined, and a value corresponding to said rotation 
amount is made said second data. 

25. A data processing system for coding first data in ac- 
cordance with second data and for decoding said 
coded data, comprising: 

storage means for storing at least partial data 
of said first data; 

coding means for embedding data in relation to 
said second data into said first data by rotating 
said at least partial data stored in said storage 
means in accordance with said second data; 
rotation means for rotating said at least partial 
data of said coded data; 
correlation calculating means for calculating a 
con-elation between said at least partial data ro- 
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tated by said rotation means and peripheral da- 
ta of said at least partial data; 
second data decoding means for decoding said 
second data embedded in said coded data by 
determining a rotation amount of said at least 5 
partial data of said coded data rotated by said 
rotation means based on said con^elation ob- 
tained by said correlation calculating means; 
and 

first data decoding means for decoding said io 
coded data to said original first data in accord- 
ance with said rotation amount determined by 
said second data decoding means. 



of said first data in said coding step is prohibited in 
a part of said first data. 

32. The product according to claim 28, wherein in said 
coding step, a rotation operation of said first image 
data is performed toward said predetermined direc- 
tion in proportion to an amount corresponding to a 
value of said second data. 

33. A computer program product comprising a program 
for decoding coded data in which first data has been 
coded in accordance with second data, said pro- 
gram providing: 



26. A computer program product comprising a program 
for coding first data in accordance with second data, 
said program providing: 

a step of storing at least partial data of said first 

data; 

and 

a coding step of embedding data in relation to 
said second data into said first data by rotating 
said stored at least partial data in accordance 
with said second data. 

27. The product according to claim 26, wherein said 
program further comprises a step of inputting said 
first data and said second data. 

28. The product according to claim 26, wherein: said 
first data is image data composed of a plurality of 
pixel data; 

In said storing step, a series of pixel data ar- 
ranged in a predetermined direction on said first 
image data is stored; and 
in said coding step, a rotation operation of said 
stored series of pixel data is performed toward 
said predetermined direction in accordance 
with said second data, so that said data in re- 
lation to said second data is embedded in said 
first image data. 

29. The product according to claim 28, wherein in said 
coding step, said series of pixel data arranged in 
said predetermined direction on said first image da- 
ta and in a frame of said image data are rotated to- 
ward said predetermined direction in accordance 
with said second data. 

30. The product according to claim 28, wherein in said 
coding step, a rotation operation of pixels of one line 
arranged in a horizontal direction on said first image 
data is performed toward said horizontal direction 
in accordance with said second data. 

31. The product according to claim 26, wherein rotation 



15 a step of rotating at least partial data of said 

coded data; 

a step of calculating a correlation between said 
rotated at least partial data and peripheral data 
of said at least partial data; 
20 a step of decoding said second data embedded 

in said coded data by determining a rotation 
amount of said at least partial data of said cod- 
ed data rotated in said rotating step based on 
said correlation; and 
25 a step of decoding said coded data to said orig- 

inal first data in accordance with said deter- 
mined rotation amount. 

34. The product according to claim 33, wherein in said 
30 step of decoding said second data, a plurality of cor- 
relations between said rotated at least partial data 
and said peripheral data of said at least partial data 
are obtained for every different value of said rotation 
amount, and said rotation amount when said corre- 

35 latlon is maximum is determined. 

35. The product according to claim 33, wherein said first 
data is Image data composed of a plurality of pixel 
data, and 

40 in said rotating step, pixel data of one line ar- 

ranged in a horizontal direction on said coded data 
Is rotated toward said horizontal direction. 

36. The product according to claim 33, wherein rotation 
45 in said rotating step is prohibited in a part of said 

coded data. 

37. The product according to claim 33, wherein in said 
step of decoding said second data, a rotation 

50 amount of said at least partial data of said coded 
data rotated in said rotating step is determined, and 
a value corresponding to said rotation amount is 
made said second data. 

55 38. A signal including a computer-controllable program 
for coding first data in accordance with second data, 
said program comprising: 
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a step of decoding said second data embedded 
in said coded data by determining a rotation 
amount of said at least partial data of said cod- 
ed data rotated in said rotating step based on 
5 said correlation; and 

a step of decoding said coded data to said orig- 
inal first data in accordance with said deter- 
mined rotation amount. 

10 46. The signal according to claim 45. wherein in said 
step of decoding said second data, a plurality of cor- 
relations between said rotated at least partial data 
and said peripheral data of said at least partial data 
are obtained for every different value of said rotation 

15 amount, and said rotation amount when said corre- 
lation is maximum is determined. 

47. The signal according to claim 45, wherein said first 
data is image data composed of a plurality of pixel 
20 data, and 

in said rotating step, pixel data of one line ar- 
ranged in a horizontal direction on said coded data 
is rotated toward said horizontal direction. 



a step of storing at least partial data of said first 
data; and 

a coding step of embedding data in relation to 
said second data into said first data by rotating 
said stored at least partial data in accordance 
with said second data. 

39. The signal according to claim 38. wherein said pro- 
gram further comprises a step of inputting said first 
data and said second data. 

40. The signal according to claim 38. wherein: 

said first data is image data composed of a plu- 
rality of pixel data; 

in said storing step, a series of pixel data ar- 
ranged In a predetermined direction on said first 
image data are stored; and 
in said coding step, a rotation operation of said 
stored series of pixel data is performed toward 
said predetermined direction in accordance 
with said second data, so that said data in re- 
lation to said second data is embedded in said 
first Image data. 

41. The signal according to claim 40, wherein in said 
coding step, said series of pixel data an-anged In 
said predetermined direction on said first image da- 
ta and in a frame of said image data are rotated to- 
ward said predetermined direction in accordance 
with said second data. 

42. The signal according to claim 40, wherein in said 
coding step, a rotation operation of pixels of one line 
arranged in a horizontal direction on said first image 
data is performed toward said horizontal direction 
in accordance with said second data. 

43. The signal according to claim 38. wherein rotation 
of said first data in said coding step Is prohibited In 
a part of said first data. 

44. The signal according to claim 40, wherein in said 
coding step, a rotation operation of said first image 
data is performed toward said predetermined direc- 
tion in proportion to an amount corresponding to a 
value of said second data. 

45. The signal including a decoding method for decod- 
ing coded data In which first data has been coded 
in accordance with second data, said decoding 
method comprising: 

a step of rotating at least partial data of said 
coded data; 

a step of calculating a correlation between said 
rotated at least partial data and peripheral data 
of said at least partial data; 



25 48. The signal according to claim 45, wherein rotation 
In said rotating step is prohibited In a part of said 
coded data. 

49. The signal according to claim 46, wherein in said 
30 step of decoding said second data, a rotation 

amount of said at least partial data of said coded 
data rotated in said rotating step is determined, and 
a value corresponding to said rotation amount is 
made said second data. 

35 

50. The signal including first data coded in accordance 
with second data through a computer-controllable 
program, said program comprising: 

40 a step of storing at least partial data of said first 

data; and 

a coding step of embedding data in relation to 
said second data Into said first data by rotating 
said stored at least partial data in accordance 
45 with said second data. 

51. The signal according to claim 50, wherein said pro- 
gram further comprises a step of inputting said first 
data and said second data. 

50 

52. The signal according to claim 50, wherein: 

said first data is image data composed of a plu- 
rality of pixel data; 
55 in said storing step, a series of pixel data ar- 

ranged in a predetermined direction on said first 
Image data are stored; and 
In said coding step, a rotation operation of said 
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stored series of pixel data is performed toward 
said predetermined direction in accordance 
with said second data, so that said data in re- 
lation to said second data is embedded in said 
first image data. s 

53. The signal according to claim 52, wherein in said 
coding step, said series of pixel data anranged in 
said predetermined direction on said first image da- 
ta and in a frame of said image data are rotated to- io 
ward said predetermined direction in accordance 
with said second data. 

54. The signal according to claim 52, wherein in said 
coding step, a rotation operation of pixels of one line 15 
arranged in a horizontal direction on said first image 
data Is performed toward said horizontal direction 

in accordance with said second data. 

55. The signal according to claim 50, wherein rotation 20 
of said first data in said coding step is prohibited in 

a part of said first data. 

56. The signal according to claim 52, wherein in said 
coding step, a rotation operation of said first image 25 
data is performed toward said predetermined direc- 
tion in proportion to an amount corresponding to a 
value of said second data. 

57. The computer program product according to any 30 
one of Claims 26 to 37 comprising a computer pro- 
gram on a carrier medium. 

58. The product of Claim 57, wherein the carrier medi- 
um is a storage medium. 35 

59. The product of Claim 57, wherein the carrier medi- 
um is a transmissions medium. 
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